MULTIMEDIA TRANSCODING PROXY SERVER FOR WIRELESS 
TELECOMMUNICATION SYSTEM 



CROSS-REFERENCE TO RELATED APPLICATION 

This application claims priority from Provisional Application No. 60/454,391, filed 
March 12, 2003, entitled "Multimedia Transcoding Proxy Server for Wireless 
Telecommunication System" which is incorporated herein by reference in its entirety. 

I. Field of Invention 

The present invention relates generally to computer-based communication systems. 

II. Background of Invention 

Digital multimedia data such as video and music can be transmitted wirelessly to mobile 
receivers, such as. wireless telephones, for playing of the multimedia by users of the mobile 
receivers. Such multimedia data may be broadcast by wireless telecommunications systems to 
mobile stations such as wireless telephones. 

Multimedia, which consumes a relatively large amount of bandwidth, may share the 
wireless spectrum with voice and data calls. This limits the number of users who can be 
serviced simultaneously. Moreover, because voice calls have priority, during periods of high 
usage multimedia service may be interrupted, however temporarily, affecting the quality of 
service provided. 

This problem stems in part from the lack of control current wireless service providers 
have in the generation of multimedia streams. Multimedia streams may be from, e.g., the 
Internet or other source without any knowledge of the data type being transferred and no 
control over the characteristics of the multimedia stream being sent. This means that the 
service provider has no control over the bandwidth requirements of the multimedia stream 
being requested by and transmitted to a user. For instance, a stream is transmitted in whatever 
encoded form in which it might have originated, regardless of the preferences or capabilities 
of the users who are to receive that particular stream and regardless of the current bandwidth 
situation of the wireless provider. Consequently, a stream might be encoded at too low a 
compression ratio (i.e., require too much bandwidth) and thus be relatively voluminous, 
compared to a stream encoded at a higher compression ratio, thereby rendering a higher 
quality of service than a user might prefer or be able to use, regardless of the bandwidth 
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available to the service provider. As recognized herein, the service provider might have to 
interrupt such a stream during periods of high usage, whereas the same stream encoded at a 
higher rate (i.e. using a higher compression ratio, or reduced resolution or reduced picture 
quality) might not have to be interrupted. Limitations such as mobile device display 
resolution, color depth, update rate, RAM, CPU speed as well as bandwidth allocation, user 
preferences, etc. could be used by a service, provider to better manager the bandwidth 
available for all users and thus provide better quality service to a greater number of potential 
customers. Unfortunately, because the service provider has no control over encoding, such 
flexibility currently is not possible. 

SUMMARY OF THE INVENTION 

A communication system includes a decoder receiving incoming encoded multimedia 
streams and decoding the streams to render decoded streams, and an encoding system that is 
configured for receiving a decoded stream and encoding it using one of at least two encoding 
parameter sets to render an encoded stream. A computer determines which encoding 
parameter set to use to encode a decoded stream, and a wireless transceiver transmits an 
encoded stream. 

Preferably, the computer determines which encoding parameter set to use based at least 
in part on a system bandwidth, and/or a current available system bandwidth, and/or a wireless 
mobile receiver capability, and/or a number of users requesting a specific multimedia stream 
at a designated QoS for that stream, and/or a multimedia data type, and/or a wireless user 
preference. A user's service classification may be used to generate billing information. Also, 
characteristics of the encoded multimedia stream, as well as mobile receiver capabilities, can 
be used to generate billing information. 

If desired, one encoding parameter set may be capable of encoding a multimedia stream 
at a resolution of QCIF or smaller. Another encoding parameter set may be capable of 
encoding a multimedia stream at a resolution of CIF or larger. 

In another aspect, a method for wirelessly providing digital multimedia includes 
receiving an encoded multimedia stream, and decoding the stream to render a decoded stream. 
The method also includes selecting at least one of at least two encoding schemes to re-encode 
the stream at a wireless provider facility to render a re-encoded stream. The re-encoded 
stream is wirelessly transmitted to a wireless mobile station. 
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In still another aspect, a wireless provider system includes means for decoding a 
received encoded multimedia stream, and first means for re-encoding the stream. Second 
means for re-encoding the stream are also provided. Logic means determine which one of the 
first and second means for re-encoding to use, based on at least one factor. 

The details of the present invention, both as to its structure and operation, can best be 
understood in reference to the accompanying drawings, in which like reference numerals refer 
to like parts, and in which: 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram of the present system; and 
Figure 2 is a flow chart of the present process. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

Referring initially to Figure 1, a system is shown, generally designated 10, that includes 
wireless service provider equipment 12 that receives multimedia streams and that transmits 
the streams wirelessly to mobile stations 14 (only a single station 14 is shown for clarity) in 
broadcast, multicast, or point-to-point transactions. In a non-limiting exemplary embodiment, 
the streams may be received from any source, such as, e.g., the Internet 16, and the streams 
may originate from a multimedia source computer 18 that can process streams generated by 
multimedia sources such as but not limited to surveillance video Web cameras 20. In the 
exemplary non-limiting architecture shown in Figure 1, the source computer 18 may encode 
multimedia streams from the Web cameras 20 in accordance with encoding principles known 
in the art prior to sending the streams to the Internet 16. 

As shown, the wireless provider member, which can be a network control center, can 
include a wireless provider computer 22 that communicates with at least one decoder 24 that 
decodes multimedia streams. The decoder 24 and/or provider computer 22 communicate with 
an encode manager 26, which receives input from a customer and bandwidth (CB) manager 28 
to select an encoding parameter set to re-encode the decoded stream. Accordingly, the service 
provider computer 22 is also associated with at least two encoder parameter sets 30 (three 
sets, labelled A, B, and C, are shown in Figure 1) that are executed by an encoding system 32. 
By "encoder parameter set" is meant a set of parameters, relating to characteristics such as but 
not limited to encoding rate, frame rate, bit resolution, etc., that are used by an encoding 
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algorithm of a software- or hardware-implemented encoder to encode the multimedia streams. 
The components 22, 26, 28 may be implemented in respective computers or by a single 
computer. 

[0016] In one non-limiting embodiment, the encoding system 32 has only one encoder that 

executes an encoding algorithm or algorithms selectively using the appropriate parameter set 
30 as set forth further below. In other embodiments, the encoding system 32 may have plural 
encoders, with each encoder parameter set 30 being executed by its own respective encoder. 
Accordingly, each encoder parameter set 30 can be executed by the encoding system 32 to re- 
encode an input stream in accordance with principles set forth further below in a way that can 
be different from the original encoding. 

[0017] Specifically, the service provider system 12 can manage bandwidth by selecting an 

appropriate encoding set 30 (i.e., encoding parameter set A or B or C, etc.) The CB manager 
28 determines the bandwidth that is available for the current requested multimedia stream by 
examining the current number and types of users using the system. The CB manager 28 can 
query the multimedia application on the mobile station 14 if desired for quality of service 
(QoS), resolution and other appropriate device and user requirements and limitations. The CB 
manager 28 then informs the encode manager 26 of the parameter information needed to start 
(or reuse) the appropriate encoding parameters for the required multimedia stream. In 
response, the encode manager 26 implements the appropriate encoding parameter set 30 by 
starting an encoder in its suite, sending the output of the encoder to ancillary transceiver 
components and antenna 34. If an existing encoding parameter set is already generating an 
appropriate stream then the encode manager 26 informs the ancillary transceiver components 
34 as to which output to use for this user application. Datastream replication can be 
performed by either the encoding system 28 or the ancillary transceiver components 34. 

[0018] In a non-limiting exemplary embodiment, for example a source video stream with VGA 

(640x480 pixels) resolution and a frame rate of thirty frames per second (fps), one encoding 
parameter set 30 may be executed by the encoding system 28 to re-encode the output video to 
QCIF (176x144 is common in current handheld devices) at ten fps and requiring an average 
bandwidth (B W) of sixteen kbps (kilo bits per second) another encoding parameter set 30 may 
be executed by the encoding system 28 to re-encode video at QCIF at fifteen fps and thirty 
two kbps, and a third set 30 can be used to encode video at size CIF (352x288) at fifteen fps 
and sixty four kbps, although other encoding types and parameters can be used. For instance, 
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one encoding set 30 may be used to encode data at a low rate (16kbps), one might be used to 
encode data at an intermediate rate (32kbps), and a third encoding parameter set 30 may be 
used to encode multimedia data at a high rate (64- 128kbps). Or, the different encoding sets 
might be used to encode different amounts of the stream, e.g., one encoding set might be used 
to discard an enhancement layer and encode only the base layer of an MPEG4 stream for 
transmission of the base layer only, whereas another encoding set might be used to encode 
more than one layer for transmission. 
[0019] As mentioned above, after re-encoding, the digitized multimedia streams are sent to 

ancillary wireless transceiver components 34 for processing and wireless transmission in 
accordance with wireless communication principles known in the art. The transceiver 
components 34 can use, without limitation, CDMA principles, GSM principles, or other 
wireless principles including wideband CDMA (WCDMA), cdma2000 (such as cdma2000 lx 
or 3x air interface standards, for example), TDMA, or TD-SCDMA, and OFDM. The 
transceiver components 34 might also use broadcast techniques particular to cellular 
implementations. 

[0020] As shown, the mobile station 14 includes a processor 36 that drives an audio or video 

display 38, for presenting the multimedia streams on the display 38. Also, the mobile station 
14 includes at least one communication transceiver 40 for communicating with the service 
provider 12. The mobile station 14 may be a mobile telephone made by Kyocera, Samsung, 
or other manufacturer that use, in a non-limiting exemplary case, Code Division Multiple 
Access (CDMA) principles and CDMA over-the-air (OTA) communication air interfaces. 
The present invention, however, applies to other mobile stations such as laptop computers, 
wireless handsets or telephones, data transceivers, or paging and position determination 
receivers. The mobile stations can be hand-held or portable as in vehicle-mounted (including 
cars, trucks, boats, planes, trains), as desired. However, while wireless communication 
devices are generally viewed as being mobile, it is to be understood that the present invention 
can be applied to "fixed 11 units in some implementations. Also, the present invention applies 
to data modules or modems used to transfer voice and/or data information including digitized 
video information, and may communicate with other devices using wired or wireless links. 
Further, commands might be used to cause modems or modules to work in a predetermined 
coordinated or associated manner to transfer information over multiple communication 
channels. Wireless communication devices are also sometimes referred to as user terminals, 
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mobile stations, mobile units, subscriber units, mobile radios or radiotelephones, wireless 
units, or simply as "users" and "mobiles" in some communication systems. 

Figure 2 shows the logic of the present invention. Commencing at block 42 an incoming 
multimedia stream (from, e.g., the Internet 16) is decoded by the decoder 24. Moving to block 
44, the encode manager 26, in accordance with input received from the CB manager 28, 
determines which one of the encoding parameter sets 30 will re-encode the stream based on 
one or more factors as discussed above and as further elucidated on below. 

For instance, one exemplary factor includes system bandwidth, such as projected system 
bandwidth or current system bandwidth. As an example, if the current system bandwidth is 
relatively unused, a multimedia stream might be re-encoded at a rate that maximizes quality of 
service (QOS) at the receiving mobile stations 14. On the other hand, if the total system 
bandwidth is highly allocated, a multimedia stream might be re-encoded at a rate that 
maximizes data compression at the expense of quality of service at the receiving mobile 
stations 14. Projected bandwidth based on historical usage can be used in a similar way to 
anticipate and thus accommodate, e.g., increased system demand. The CB manager 28 is able 
to reject a request based on limitation of bandwidth, minimum QoS required, etc. 

Another exemplary factor includes simplification of mobile receiver device decoder 
development. For instance, if the web cam or other multimedia stream selected is compressed 
and/or encoded in a format (call it format X) that is not supported by the mobile device, then a 
user could not use that stream. If, however, the service provider added a decoder for format 
X, then the service provider can send out a stream that is encoded in a format that the mobile 
station can use. This feature also allows the mobile station development and decoder software 
storage and hardware implementations to be simpler and cheaper. 

A further exemplary factor used in determining which encoding parameter set 30 to use 
might be a wireless user characteristic. For example, if the mobile station 14 to which a 
particular stream is to be transmitted can use only highly compressed streams, and does not 
have sufficient system fidelity to use lightly-compressed, high QOS streams, the encoding 
parameter set 30 that most highly compresses the stream might be selected. On the other 
hand, a high performance mobile station 14 might be capable of enhancing the display of the 
multimedia stream if the stream is encoded to maximize QOS. For instance, a high 
performance mobile station 14 might be capable of displaying a CIF sized video stream 
because it includes a relatively large display. For such a mobile device, an encoding 
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parameter set 30 which provides the higher resolution could be selected. Conversely, if a 
mobile station can display only a QCIF image, then an encoding parameter set providing a 
smaller QCIF image would be selected. Other factors might also effect the selection of 
encoders such as bits per pixel that can be displayed on the mobile device (it is common for 
current phone displays to provide only sixteen bits per pixel as apposed to twenty four and 
thirty two bits per pixel available on typical PC displays), screen refresh rate (current mobile 
displays can have update rates that are less than seven fps), CPU speed (i.e., a CPU might only 
have enough MIPS to decode five fps versus ten or fifteen fps), etc. For audio, a receiver may 
only be capable of mono vs stereo sound (many mobiles have limited speaker and speaker 
option capability), and many other multimedia device specific factors. 

An additional example of a factor used in determining which encoding parameter set 30 
to use might be a multimedia data type. More specifically, the re-encoding of a particular 
stream might be established based on the type of multimedia data it represents. For example, 
music might be re-encoded using one encoding parameter set 30 that is appropriate for audio 
encoding while video might be re-encoded using another encoding parameter set 30 that is 
more appropriate for video. 

Further, a user may choose to utilize only select portions of a requested multimedia 
stream. For example a multimedia stream might include audio, video and test data. A user 
might not wish to view the video or text but might still want to listen to the audio portion of 
the stream. The user would indicate this through user preferences communicated to the 
encode manager 26 to start an audio-only encoding parameter set and by doing so, require 
significantly less total bandwidth for this multimedia stream for this specific user. 

A still further example of a factor used in determining which encoding parameter set 30 
to use might be a user preference. Specifically, a user of a mobile station 14 might demand 
the highest QOS possible, and so multimedia streams sent to that user would be re-encoded 
with the encoding parameter set 30 providing the highest QOS. The service provider may 
choose to charge the user a premium for this service option. Another user might demand the 
lowest cost possible. Multimedia streams sent to such a user might be re-encoded to achieve 
high compression with lower QOS. The user preference can then be used to generate billing 
information, with higher demanded QOS being billed at higher rates than lower demanded 
QOS. In addition, the service provider can choose to alter billing according to data rates used, 
QoS, current BW availability, system capacity, etc. 
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[0028] When a combination of factors is to be used, the present invention contemplates any 

number of encoder selection heuristics. For instance, even during periods of high usage of the 
bandwidth a user demanding high QOS can be serviced as demanded by appropriate selection 
of an encoding parameter set 30, and perhaps billed more for such service during peak usage 
times. Or, the opposite principle may be chosen, namely, during periods of high usage, a user 
might be provided with a basic level of service that might be below that demanded, with the 
user's bill reduced accordingly. An intermediate strategy might be employed in which, during 
periods of peak system use, a first user demanding high QOS is given an intermediate QOS by 
appropriate selection of an encoding parameter set 30 to encode the first user's stream, while 
other users not demanding any particular QOS are given low QOS by appropriate selection of 
another encoding parameter set 30 to encode their streams. Further, one or more requested 
streams which could require substantial bandwidth might be temporarily denied service during 
peak usage periods in order to allow the service provider to guarantee quality voice service for 
customers. 

[0029] Once it has been determined which encoding parameter set 30 to use for a particular 

multimedia stream, the logic moves to block 46. At block 46, the selected encoding 
parameter set 30 is used by the encoding system 32 to re-encode the stream for subsequent 
transmission to one or more mobile stations 14. In this way, the service provider 12 maintains 
control over the bandwidth used per user, with the re-encoding being dynamically customized 
for the system bandwidth, user capabilities, or user preferences, or some combination of the 
above. These principals can also be applied to systems supporting multicast and broadcast 
over wireless. 

[0030] While the particular embodiment as herein shown and described in detail is fully capable 

of attaining the above-described objects of the invention, it is to be understood that it is the 
presently preferred embodiment of the present invention and is thus representative of the 
subject matter which is broadly contemplated by the present invention, that the scope of the 
present invention fully encompasses other embodiments which may become obvious to those 
skilled in the art, and that the scope of the present invention is accordingly to be limited by 
nothing other than the appended claims, in which reference to an element in the singular is not 
intended to mean "one and only one" unless explicitly so stated, but rather "one or more". All 
structural and functional equivalents to the elements of the above-described preferred 
embodiment that are known or later come to be known to those of ordinary skill in the art are 
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expressly incorporated herein by reference and are intended to be encompassed by the present 
claims. Moreover, it is not necessary for a device or method to address each and every 
problem sought to be solved by the present invention, for it to be encompassed by the present 
claims. Furthermore, no element, component, or method step in the present disclosure is 
intended to be dedicated to the public regardless of whether the element, component, or 
method step is explicitly recited in the claims. No claim element herein is to be construed 
under the provisions of 35 U.S.C. '1 12, sixth paragraph, unless the element is expressly recited 
using the phrase "means for" or, in the case of a method claim, the element is recited as a 
"step" instead of an "act". 



